Adaptive Risk Bounds in Unimodal Regression

نویسندگان

  • Sabyasachi Chatterjee
  • John Lafferty
چکیده

We study the statistical properties of the least squares estimator in unimodal sequence estimation. Although closely related to isotonic regression, unimodal regression has not been as extensively studied. We show that the unimodal least squares estimator is adaptive in the sense that the risk scales as a function of the number of values in the true underlying sequence. Such adaptivity properties have been shown for isotonic regression by Chatterjee et al. (2015b) and Bellec (2016). A technical complication in unimodal regression is the nonconvexity of the underlying parameter space. We develop a general variational representation of the risk that holds whenever the parameter space can be expressed as a finite union of convex sets, using techniques that may be of interest in other settings.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Polyshrink: An Adaptive Variable Selection Procedure That Is Competitive with Bayes Experts

We propose an adaptive shrinkage estimator for use in regression problems charaterized by many predictors, such as wavelet estimation. Adaptive estimators perform well over a variety of circumstances, such as regression models in which few, some or many coefficients are zero. Our estimator, PolyShrink, adaptively varies the amount of shrinkage to suit the estimation task. Whereas hard threshold...

متن کامل

Adaptive Variable Selection with Bayesian Oracles

We analyze the performance of adaptive variable selection with the aid of a Bayesian oracle. A Bayesian oracle supplies the statistician with a distribution for the unknown model parameters, here the coefficients in an orthonormal regression. We derive lower bounds for the predictive risk of regression models constructed with the aid of a class of Bayesian oracles, those that are unimodal and s...

متن کامل

On discrete a-unimodal and a-monotone distributions

Unimodality is one of the building structures of distributions that like skewness, kurtosis and symmetry is visible in the shape of a function. Comparing two different distributions, can be a very difficult task. But if both the distributions are of the same types, for example both are unimodal, for comparison we may just compare the modes, dispersions and skewness. So, the concept of unimodali...

متن کامل

Margin Adaptive Risk Bounds for Classification Trees

Margin adaptive risk bounds for Classification and Regression Trees (CART, Breiman et. al. 1984) classifiers are obtained in the binary supervised classification framework. These risk bounds are obtained conditionally on the construction of the maximal deep binary tree and permit to prove that the linear penalty used in the CART pruning algorithm is valid under margin condition. It is also show...

متن کامل

Physical Measures for Infinitely Renormalizable Lorenz Maps

A physical measure on the attractor of a system describes the statistical behavior of typical orbits. An example occurs in unimodal dynamics. Namely, all infinitely renormalizable unimodal maps have a physical measure. For Lorenz dynamics, even in the simple case of infinitely renormalizable systems, the existence of physical measures is more delicate. In this article we construct examples of i...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016